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Abstract 

In this paper, we will develop a tool to analyze polling systems with the 
autonomous- server, the time-limited, and the k-limited service discipline. 
It is known that these disciplines do not satisfy the well-known branching 
property in polling system, therefore, hardly any exact result exists in the 
literature for them. Our strategy is to apply an iterative scheme that is 
based on relating in closed-form the joint queue-length at the beginning 
and the end of a server visit to a queue. These kernel relations are derived 
using the theory of absorbing Markov chains. Finally, we will show that 
our tool works also in the case of a tandem queueing network with a single 
server that can serve one queue at a time. 
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1 Introduction 

Polling systems have been extensively studied in the last years due to their 
vast area of applications in production and telecommunication systems [HI [16] . 
They have demonstrated to offer an adequate modeling framework to analyze 
systems in which a set of entities need certain service from a single resource. 
These entities are located at different positions in the system awaiting their turn 
to receive service. 

In queueing theory, a polling system is equivalent to a set of queues with 
exogenous job arrivals all requiring an amount of service from a single server. 
The server serves each queue according to a specific service discipline and after 
serving a queue he will move to a next queue. A key role in the analysis of 
such polling systems is played by the so-called branching property [IS]. This 
property states that each job present at a queue at the arrival instant of the 
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server will be replaced in an independent and indentically distributed manner 
by a random number of jobs during the course of the server's visit. Service 
disciplines satisfying the branching property yield a tractable analysis, while for 
disciplines not satisfying this property hardly any exact results are known. 

The two most well-known disciplines that satisfy the bran- ching property are 
the exhaustive and gated discipline. Exhaustive means that the server continues 
servicing a queue until it becomes empty. At this instant the server moves to 
the next queue in his schedule. Gated means that the server only serves the 
jobs present in the queue at its arrival. 

The drawback of the exhaustive and gated disciplines is that the server is 
controlled by the job arrivals. To reduce this control on the server, other type 
of service disciplines were introduced such as the time-limited and the fc-limited 
discipline. According to the time-limited discipline, the server continues ser- 
vicing a queue for a certain time period or until the queue becomes empty, 
whichever occurs first. Under the k-limited discipline, the server continues ser- 
vicing a queue until k jobs are served or the queue becomes empty, whichever 
occurs first. Another discipline, evaluated more recently in the literature and 
closely related to the time-limited discipline, is the so-called autonomous-server 
discipline [Dll] which works as follows. The server continues servicing a queue 
for a certain period of time despite that, meanwhile, the queue may become 
empty. This discipline may also be seen as the non-exhaustive time-limited 
discipline. We should emphasize that these latter disciplines do not verify the 
branching property and thus hardly any closed-form results are known for the 
queue-length distribution under these disciplines. 

To circumvent this difficulty, researchers resort to numerical methods using 
for instance iterative solution techniques or by using a power series algorithm. 
The power series algorithm [31 aims at solving the global balance equations. 
To this end, the state probabilities are written as a power series and via a com- 
plex computation scheme the coefficients of these series, and thus the queue- 
length probabilities, are obtained. The iterative techniques [TUJ [TT] exploit the 
relations between the joint queue-length distributions at specific instants, viz., 
the start of a server visit and the end of a server visit. The relation between 
the queue length at the start and end of a visit to a queue is established via 
recursively expressing the queue length at a job departure instant in terms of 
the queue length at the previous departure instant of a job. The complemen- 
tary relation, between the queue length at the end of a visit to a queue and a 
start of visit to a next queue, can easily be established via the switch-over time. 
Starting with an initial distribution, the stationary queue-length distribution is 
then obtained by means of iteration. Although these methods offer a way to 
numerically solve intrinsically hard systems, their solution provides little funda- 
mental insight and moreover the computation time and memory requirements 
to obtain this solution are exponential functions of the number of queues. 

In this paper, we develop a tool to analyze the autonomous server, the time- 
limited, and the k-limited discipline. Our tool incorporates an iterative solution 
method which enhances the method introduced in [10]. More specifically, con- 
trary to that approach, we will establish a direct and more insightful relation 
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between the joint number of jobs at the beginning and end of a visit period to 
a queue without conditioning on any intermediate events that occur during a 
visit. To this end, we use the theory of absorbing Markov chains (AMC) [^[TB], 
We construct an AMC whose transient states represent the states of the poUing 
system. The event of the server leaving a queue is modeled as an absorbing 
event. We will set the initial state of the AMC to the joint number of jobs at 
the beginning of a service period of a queue. Therefore, to find the joint number 
of jobs at the end of a service period, it is sufficient to keep track of the state 
from which the transition to the absorption state occurs. The probability of the 
latter event is eventually determined by first ordering the states in a careful way 
and consequently exploiting the structures that arise in the generator matrix 
of the AMC. Following this approach, we relate in closed-form the joint queue- 
length probability generating functions (p.g.f.) at the end of a visit period to 
a queue to the joint queue-length p.g.f. at the beginning of this visit period. 
The major part of this paper is devoted to deriving these kernel relations for 
the above-mentioned three disciplines: autonomous-server, time-limited, and k- 
limited. Once these relations are obtained, the joint queue-length distribution 
at server departure instants is readily obtained via a simple iterative scheme. 

The paper is organized as follows. In Section [2] we give a careful description 
of the model and the assumptions. Section [3] analyses the autonomous-server 
discipline. In Section[3]we study the time-limited discipline. Section [S] evaluates 
the k-limited discipline. In Section [S] we describe the iterative scheme that is 
important to compute the joint queue-length distribution. Section [7] analyses 
briefly the tandem model case with the autonomous-server and the time-limited 
service discipline. Finally, in Section [H we conclude the paper and give some 
research directions. 

2 Model 

We consider a single-server polling model consisting of M first-in-first-out (FIFO) 
systems with unlimited queue, Qi, i = 1, . . . , M. Jobs arrive to Qi according 
to a Poisson process with arrival rate A^. We let Ni(t) denote the number of 
jobs in Qi, i = 1, . . . ,M, at time t > and it is assumed that iVi(O) = 0, 
« = 1, • . ■ , M. The service requirement Bi at Qi has an exponential distribution 
and mean hi. We assume that the service requirements are independent 
and identically distributed (iid) random variables (rvs). The server visits the 
queues in a cyclic fashion. After a visit to Qi, the server incurs a switch-over 
time from Qi to Qi+i. We assume that is independent of the service re- 
quirement and follows a general distribution C*(-) with mean c', where at least 
one c* > 0. The service discipline at each queue is either autonomous-server, 
time-limited, or /c-limited. It is assumed that the queues of the polling system 
are stable. 

In case the server is active at the end of a server visit, which may happen 
under the autonomous-server and time-limited disciplines, then the service will 
be preempted. At the beginning of the next visit of the server, the service time 
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will be rc-samplcd according to -Bi(-). This discipline is commonly referred to 
as preemptive-repeat-random. 

A word on notation. Given a random variable X, X{t) will denote its dis- 
tribution function. Wc use I to denote an identity matrix of appropriate size 
and use ® as tensor product operator defined as follows. Let A and B be two 
matrices and a{i,j) and b{i,j) denote the (i,j)-entries of A and B respectively 
then A ® B is a block matrix where the (i,j)-bIock is equal to b(i,j) A. We use e 
to denote a row vector of elements equal to one and Cj to denote a row vector 
with the i-th element equal to one and the other elements equal to zero. Finally, 
v'^ will denote the transpose of vector v. 

3 Autonomous-server discipline 

In this section, wc will relate the joint queue-length probabilities at the begin- 
ning and end of a server visit to a queue for the autonomous-server discipline. 
Under the autonomous-server discipline, the server remains at location Qi an 
exponentially distributed time with rate before it migrates to the next queue 
in the cycle. It is stressed that even when Qi becomes empty, the server will 
remain at this queue. 

Without loss of generality let us consider a server visit to Qi. We assume 
that the p.g.f. of the steady-state queue-length at service's beginning instant 
at Qi, denoted by is known, where z := {zi, . . . ,Zm) and \zi\ < 1 for 

i = 1, . . . , M. The aim is to derive the p.g.f. of the steady-state queue- length at 
service visit's end at Qi, denoted by 7]^(z). In order to compute 7j^(z), we first 
assume that Qi has a limited length of L — 1 jobs including the job in service. 
This queue is denoted by Qf. Later, we will let L tend to infinity to get the 
desired results. 

The probability that there are (ii, zm) jobs in (Qi, . . . , Qm) at the begin- 
ning of a server visit to Qi is denoted by Pl(N5 = (ii, . . . , JAf))- Similarly, the 
probability that there are (ji, ■■■,jM) jobs in {Qi, . . . , Qm) at the end of a server 
visit to Qi is denoted by PL(Nf = {ji, ■ ■ . ,jM) \ = (ii, . . • ,iM))- Under the 
assumption that the unlimited Qi is stable, lim£,_>oo Pi,(N5 = {ii, . . . jIm)) = 
¥{N\ = (zi, . . . , im)) and f3^{z) = E[z^"] . 

Let N(t) :— {Ni{t), . . . ,NM{t)) denote the M-dimensional, continuous-time 
Markov chain with discrete state-space ^4 = {0,1, ...,L — l}x{0,l,...}^~^U 
{a}, where Nj{t) represents the number of jobs in Qj at time t. State {a} is 
absorbing. We refer to this absorbing Markov chain by AMC^. The absorp- 
tion of AMCa occurs when the server leaves Qi which happens with rate ai. 
Moreover, the initial state of AMC^ at t = is set to the system state at 
server's arrival to Qi, i.e., = {ii, . . . ,iM)- Therefore, the probability that 
the absorption of AMC^i occurs from one of the states {{ji, ■ ■ ■ jJm)} equals 
IPi(Nf = (ji, . . . Jm) I A^i = {ii, . ■ ■,iM))- Let n = (m, ...^hm) &U- W 
and e; the M-dimensional row vector whose entries equal zero except the l-ih. 
entry that equals one. The non-zero transition rates of AMCa can be written 
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as 

q{n,n + ei) — Ai, < ni < L — 2, 

q{n,n + ei) = Xi, 2<1<M, 

g(n, n — d) = 1 < ni < L — 1, 

g(n,{a}) = ai. 

We derive now Pi:,(Nf = {ji, . ■ ■ ,jM)\ = (ii,. . . ,iM))- During a server 
visit to Qi, the number of jobs at Qi, I — 2, ... , M, may only increase. There- 
fore PL(Nf = (ji, . . . , jjvf ) I = (h, . . . , im)) is strictly positive for ji > ii, 
1 = 2,..., M, and zero otherwise. For sake of clarity, we will show first in detail 
the structure of AMC^ in the case of 3 queues, i.e. for M = 3, before consid- 
ering the general case. 



Case M=3. Let us consider the transient states of AMC^i, i.e., (71,1,77,2,713) € 
— {a}, where ni € {0, 1, . . . , L — 1} and 712, ns S {0, 1, . . . }. We recall that 
we consider a server visit to Qi- The number of jobs at Q2 and Q3 may only in- 
crease during a server visit to Qi, while the number of jobs at Qi may increase or 
decrease. To take advantage of this property, we will order the transient states 
of the AMCa as follows: (0, 0, 0), (1, 0, 0), (2, 0, 0), ... , (0, 1, 0), (1, 1, 0), (2, 1, 0), 
. . . , (0, 0, 1), (1, 0, 1), (2, 0, 1), . . ., i.e., lexicographically orde- red first according 
to ns, then n2, and finally according to ni. This ordering induces that the 
generator matrix of the transition rates between the transient states of AMC^ 
for M = 3, denoted by Q3, satisfies the following structure. That is, Q3 is 
an infinite upper-bidiagonal block matrix with diagonal blocks equal to A3 and 
upper-diagonal blocks equal A3I, i.e., 



Q3 



A3 




A3I 
A3 





A3I 



/ 



(1) 



We note that A3 denotes the generator matrix of the transitions which do not 

induce any modification in the number of jobs at Q^. Moreover, A3I denotes the 
transition rate matrix between the transient states (ni, 7X2, ns) and (ni, 77,2, 71,3 + 
1), i.e., the transitions that represent an arrival to Q3. The block matrix A3 
is also an infinite upper-bidiagonal block matrix with diagonal blocks equal to 
A2, and upper-diagonal blocks equal A2I, i.e.. 



/ A2 




A2I 
A2 





A2I 



(2) 



where A2I denotes the transition rate matrix between the transient states (711, 712, '^3) 
and (711, 7i2 + 1,713) and A2 is the generator matrix of the transition between 
the transient states (711,712, "-3) and (ni ± 1,77,2,713). Observe that A2 equals 
the sum of the generator matrix of an M/M/l/L-1 queue with arrival rate Ai 
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and departure rate 1/bi and of the matrix — (A2 + A3 + ai)!. Now, we compute 
Pl(N^ = (ji,j2,j3) I N5 = («i,i2,i3)) as function of the inverse of Q3, A3 
and A2. First note that since Q3, A3 and A2 are all sub-generators with sum 
of their row elements strictly negative, these matrices are invertible. From the 
theory of absorbing Markov chains, given that AMCa starts in state (ii, Z2, is), 
the probability that the transition to the absorption state {a} occurs from state 
0'i,i2, js) reads (see, e.g., [8]) 

Pl(N? = (ji,j2,j3) I N^) = -aiC3(Q3)-'d3, (3) 

where C3 is the probability distribution vector of AMCa's initial state that can 
be given by 

C3 := (g) ® , 

and aids is the transition rate vector to {a} given that (ji,j2j js) is the last 
state visited before absorption where ^3 can be given by 

d3 (eji ®ej^®ej^f. 

Q3 is an upper-bidiagonal block matrix. Hence, it is easy to show that (Qs)"^ is 
an upper-triangular block matrix with (i,j)-block equal to (— (A3)~^A3l)^^'(A3)~^ 
thus we find that 

C3(Q3)-'d3 = C2(-A3(A3)-l)^^-'HA3)"ld2, (4) 

where C2 = e^^ ® and ^2 — (eji ® ^n)'^ ■ Plugging ^ into ^ gives that 

Pl(N? = (J1,J2,J3) I Nj) - -aiC2(-A3(A3)-iF^-*MA3)-'d2. (5) 

General case. By analogy with the case of M = 3, we order the transient 
states of AMCyi first according to riM, then tt-m-i, ■ • and finally according 
to ni. During a server visit to Qi, the number of jobs at Qj, j — 2, . . . , A/, 
may only increase. Therefore, similarly to the case of M = 3, the AMC^ the 
generator matrix of the transition rates between the transient states of AMCa 
for the general case, denoted by Qm, is an upper-bidiagonal block matrix with 
diagonal blocks equal to Am, and upper-diagonal blocks equal to AmI- More- 
over, Am in turn is an upper-bidiagonal block matrix with diagonal blocks equal 
to Am-1, and upper-diagonal blocks equal to Am-iI- We emphasize that Aj, 
j = M, . . . , 3, all verify the previous property. Finally, the matrix A2 equals 
the sum of the generator matrix of an M/Ai/l/L-l queue with arrival rate Ai 
and departure rate and of the matrix — (A2 + . . . + Am + oli)1. 

By analogy with the M = i case, we find that the probability of Nf = 
(ji, . . . , jm), given that = (ii, . . . , im), reads 

Pi(N^ = (ji,...,jM) I N'; = (*!,..., zm)) = 

-aiCM~i{- ^KiiAmy^Y''' '"(AM)"^dAf-i- (6) 
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CM-l ■= (X) . . . (Ki e^J^^_l, 

Sji ® . . . Cj 



dM-1 ■■= (e-j 



We derive now the conditional p.g.f. of N^. Note that ( — Am(Am)~^) is a sub- 
stochastic matrix with the sum of its row elements strictly smaller than one, 
which gives that lim„^oo(— Am(Am)~^)" — 0. Combining the latter result with 
^ we find that 



z^^i I = (ii, . . .,iM) = -aiz^5^'cA/-i(AM + zmAmI) dM-i(z), (7) 



where 

L-l 

dM-i(z) := E E • • ■ E ... ziJ^_-/e,„_ J^, (8) 

il=0j2>i2 jM-l>iM-l 

and |zi| < 1, i = 1, . . . , M. It remains to find (Am + zmAmI)^^- Since Am is 
an upper-bidiagonal block matrix, the (i,j)-block of (Am + ^mAmI)~^ is given 
by (-Am-i)^~'x (Am-1 + zmAmI)"^"*"*""^- Plugging the latter result into ^ 
gives that 



Er 



z^i I N? = (zi,...,zm) 



(Am-1 + (zmAm + zm-iAm-i)!) ^rfM-2(z), (9) 



where 



CA/-2 := (g) . . . (g) e^J^^_2, 
dM-2(z) := EE--- E (^fej, (g...(gz^^'_:|e,„_,f . 

j2>i2 jM-2>iM-2 

By an induction argument along with the properties that Aj, j = 3,...,M— 1, 
is an upper-bidiagonal block matrix, it can be shown that 



0.1^2 ■ ■ ■ Zjy^ Bij 



(a2 + (Z2A2 + . . . + ZAfAM)l) ^di{zi), (10) 



where 

L-l 

di(.i) := 5]zf(e,,f = (l,zi,...,zf-Y. 
Removing the condition on , it is readily seen that 

El[z'^i] =-ai/(A2 + (22A2 + ... + ZMAM)l) 'rfi(2i), (11) 
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where / is the L-dimensional row vector with i-th clement equal to E[l|jYb^j-|. • 

^2 ^ ■ • • %/*J , for i = 0, . . . , L — 1. It remains to find the inverse of A2 + {Z2X2 + 
. . . + zmAa^)! and to let L — > 00. 

Let = (1, 0, . . . , 0) and let v'^ — (0, . . . , 0, 1). We recall that A2 equals 
the sum of the generator matrix of an M/M/l/L-1 queue with arrival rate 
Ai and departure rate l/bi and of the matrix — (A2 + . . . + Am + Q:i)I. Let 
Qa(z) := A2 + (22A2 + . . . + zmXm)1- Now, observe that Qa(z) = Ta(z) + 
1/hiUu^ + Xxvv^ , where Ta(z) is a L-by-L tridiagonal Toeplitz matrix with 

diagonal entries equal ( — Ai — — ai — X]m=2 Am(l — Zm)), upper-diagonal 
entries equal Ai, and lower-diagonal entries I/&1. Let t*^ denote the (i, j)-entry 
of T^"'"(z). By applying the Sherman-Morrison formula [Ml p. 76] we find that 
the (i, j)-entry of Qa^(z) gives for i, j = 1, . . . , L, 



Ai 



1 -I- XlTTlLL ' 



where m, 



(12) 



hi + qi 

The inverse of a tridiagonal Toeplitz matrix is known in closed-form (see [51 
Sec. 3.1]) 



('•'ll-''2l)(''ll 



t* 



Ai(rii-r2i)(rj]+ 



Ai(rii-r2i)(rj]+ 



i<J<L 



where rn and r2i are the distinct roots of 

Pi(r) i^Air^-. Sir + 1/61, 



(13) 



(14) 



where si := Ai + I/61 + ai + X]m=2 ^^"^(1 ~ -^'n)- We take |rii| < |r2i|. Note 
that |Air^ + l/6i| < | — sir| for every \r\ = 1, thus Rouche's theorem gives that 
Pi{r) has exactly one root inside the disk of radius one for all \zi\ < 1 (see, 
e.g., [7]). For this reason, we have that |rii| < 1 < |r2i|. 
Inserting the values of t*^ into (|11|) yields that 



E4zN?] 



-ai 



L-l 

E 

Xirui 



t* 



1 -I- XirriLL 



1 + 



1 + i/hq^ 



(15) 



Thus, it remains to let L ^ 00 in (fTS]) in order to find E[z'^i] . It is readily seen 
that 



lim t 

L — *oo 



1 



LL-j 



Hm uiL-iL 

L — ^00 



Air2i 
lim t 

L — ^oo 
1 



-r 



11' 



L-iL 



Ai 



'21 



Some technical calculus shows that the following limit is equal to zero 



L-.00 '^'^^^1 1 + AimLLV l + lbitij 

Finally, plugging the previous limits in (jl5p it can be shown that 



E[z^^] ^ 7i^(z) ^ ^^^^^ { ^"f'lf ' (16) 

where z* :— (rn, Z2, ■ • ■ , zm)- Eq. (fT6)) relates in closed-form 7j^(z), p.g.f. of the 
joint queue- length at the beginning of a server visit to Qi, to /3f (z), p.g.f. of 
the joint queue-length at the end of a server visit to Qi. From (fT6|) . we deduce 
that for a server visit to Qi, i = 1, ... , M, 

P,(2;,) A,2;,2 - s,zj -I- (18) 

A/ 

Si := \i + l/h + ai+ y Xm{l-Zm), (19) 

?n — l,m^z 



where 



:= (20) 

z* := (zi,...,Zi_i,rn,Zj+i,...,ZM), and \ru\ < 1. 

Finally, introducing the switch-over times from Qi-i to Qi, thus by using 
that Pf{z) = 7/l^(z)C*~^(z), where C*~^(z) is the p.g.f. of the number of 
Poisson arrivals during C'~^, we obtain 

Pi(zj)(l - rii) 



OiiZi ^ 



Pl{Zi) 



7f_i(z)C-i(z). (21) 



4 Time-Limited discipline 

In this section, we will relate the joint queue-length probabilities at the begin- 
ning and end of a server visit to a queue for the time-limited discipline. Under 
this discipline, the server departs from Qi when it becomes empty or when a 
timer of exponential distribution duration with rate has expired, whichever 
occurs first. Moreover, if the server arrives to an empty queue, he leaves the 
queue immediately and jumps to the next queue in the schedule. For this rea- 
son, we should differentiate here between the two events where the server join 
an empty and non-empty queue. 
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We will follow the same approach as in Section [31 Thus, we first assume 
that Qi has a limited queue of L — 1 jobs, second there are := (ii, ■■■tIm) 
jobs in (Qi, . . . , Qa/), with ii > 1, at the beginning time of a server visit to Qi 
and third there are := (ji, ...,jM) jobs in (Qi, . . . , Qm) at the end time of 
a server visit to Qi. Note that if Qi is empty at the beginning of a server visit, 
i.e., ii = 0, P(N^ ~ N^) = 1. We will exclude the latter obvious case from the 
analysis in the following, however, we will include it when we will uncondition 
on Nj. 

Let N(t) := {Ni{t), . . . , NM{t)) denote the A/-dimensional, continuous-time 
Markov chain with discrete state-space — ■ ■ ■ , L — 1} x {0, 1, . . .}*^~^U{a}, 
where Nj(t) represents the number of jobs in Qj at time t and at which Qi is 
being served. State {a} is absorbing. We refer to this absorbing Markov chain 
by AMCy. The absorption of AMCt occurs when the server leaves Qi which 
happens with rate ai from all transient states. The transient states of the form 
(1,^2, . . . ,7ij\/) have an additional transition rate to {a} that is equal to 1/fei, 
which represents the departure of the last job at Qi. 

We set N(0) = N\. Therefore, the probability that the absorption of AMCt 
occurs from one of the states {{ji, ■ ■ ■ , Jm)} equals PL(Nf = (ji, . . . , if 
the absorption is due to the timer expiration with rate ai. However, if the 
absorption is due to Qi becoming empty, PL(Nf = (0,^2 ■ • ■ , Jm)) equals the 
probability that the absorption with rate 1/bi occurs from one of the states 
{(1, j2, ■ • ■ ijAi)}- The non-zero transition rates of AMCy can be written for 
all n e — {a}, 

(7(n, n + ei) = Ai, ni = 1, . . . , L - 2, 
q{n,n + ei) = A;, Z = 2,...,M, 
g(n,n-ei) = l/bi, 2 < rii < L - 1, 
q(n,{a}) = ai, 2<ni<L-l, 
q{n,{a}) = ai 4- l/5i, ni = 1. 

We derive now PL(Nf = (ji, . . .Jm) \ '^'i = (ii, • ■ • We order the 

transient states lexicographically first according to tim, then to um-i, ■ ■ •, and 
finally to rii. Similarly to the time- limited discipline, during a server visit to 
Qi, the number of jobs at Qj: J = 2, . . . , Af , may only increase. It then follows 
that the transient generator of AMC^ has the same structure as the transient 
generator of AMC^i, i.e. it is an upper-bidiagonal Toeplitz matrix of upper- 
bidiagonal Toeplitz diagonal blocks. Therefore, by the same arguments as for 
the time-limited discipline, we find that the joint moment of the p.g.f. of and 
the event that the absorption is due to timer expiration, denoted by {timer}, 
given N^, reads 

• lnimer> I = (^l,...,^M) 



aizi^ . . . z]^'ei^ + (Z2A2 + . . . + ZMAAf)l) 51(2^1), 



where B2 is the sum of the generator matrix of an M/M/l/L-1 queue with 
arrival rate Ai and service rate l/bi restricted to the states with the number of 
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jobs strictly positive, and of the matrix — (A2 + . . . + AAf + Qi)!, and where 

gi(zi) := (zi, . . . 

Let, 

Qt(z) := B2 + (Z2A2 + . . . + zmXai)!. (22) 

The joint moment of the p.g.f. of Nf and the event that the absorption is due 
to empty Qi, denoted by {Qi empty}, given Nj, reads 



'-{Qi empty} 



N'l = {H,...,iM)\ = -l/6iz^^..z;fe,,(QT(z)) 'ei. 



Summing the latter two p.g.f. gives the p.g.f. of Nf given Nj, which reads 



(Qt(z)) i(gi(zi) + ^.ei), (23) 

In the final part of this section, we find the inverse of Qt(z) and let L — > 00. 

We note that Qt(z) = T(z) + Aiw'^, v = (0, . . . , 0, 1)^, where Tt(z) 
is a (L-l)-by-(L-l) tridiagonal Toeplitz matrix with diagonal entries equal to 
( — Ai — 1/bi — «! — J2m=2 ^"i(l — Zjn)) , uppcr-diagoual entries are equal to Ai, 
and lower-diagonal entries 1 /bi . We emphasize that the only difference between 
Ta(z) of the autonomous-server discipline and Tt(z) is that Ta(z) is an L-by- 
L matrix. Therefore, following the same approach as in Section [31 we find that 
the (i, j)-entry of Qt(z)"^, i, j = 1, . . . , L - 1, gives 

^'-"^ 1 + Ait(i-1,L-1)^' ^ ' 



where t{i,j)^ is the (i,j)-entry of Tt(z) that reads 



i <j < L-l 



V 11 '21 A' 11 '21 '21 ' 11 J j <. i <. L — \ 
Ai(rii-r2i)(rfi-r|'i) ' - - 

where rii and r2i are the distinct roots of Pi (r) := Air^ — sir + Inserting 
the values of q{i,j)^ into ([^5]) yields that 

El [z^^ |N? = (zi, . . . , zm) ] = -aiz^^ ■ ■ ■ x 

^,(zr,l) +E^i(^(-i-^)t-Ai i + Ai^(^„i,^_i)^ 

(26) 

Some technical calculus shows that the following limit is equal to zero 

t{^l,L~lrr y ;,j .t(L-l,j)T- 

L^oo l + Ait(L- 1,L- 1)|, ^ ^ ^ '•'^^ 
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Plugging the latter limit, q{ii^ 1)*, and j)^ in ([^ . we find that 

E[z^i |N? = (zi, . . . , ^M) ] = 4^ • ■ ^1^^ - - (27) 

Removing the condition of = (ii, . . . , iA/ ) for ii = 0, . . . , L — 1, 

where := (rn, Z2, . . . , ^Af)- From ([^5]) . we deduce that for a server visit to 
Qu 1 = 1,...,M, 

where z* = (zi, . . . , Zi„i, r^, z^+i, . . . , zm), Irnl < 1, and where Fj(zi), Si, and 
Tii are in p^ . and (^0)1 respectively. 

Finally, introducing the switch-over times from Qi_i to Q^, we obtain 

7f(z) = (i + -^)^f_,(z:)c-i(zn-;g^7ri(z)c-i(z). oo) 

5 k-Limited Discipline 

In this section, we analyze the fc-limited discipline. According to this discipline 
the server continues working at a queue until either a predefined number of k jobs 
is served or the queue becomes empty, whichever occurs first. Similarly to the 
previous disciplines, the objective is to relate the joint queue-length probabilities 
at the beginning and end of a server visit to Qi, referred to as /3i (z) and 7i (z). 

By analogy with the time-limited discipline, we will first assume that Qi has 
a limited queue of i — 1 jobs, second there are :— {ii, za/) jobs in (Qi, . . . , 
Qm), with ii > 1, at the beginning time of a server visit to Qi, and third there 
are (ji, jobs in (Qi, . . . ,Qm) at the end time of a server visit to 

Qi. Note that if Qi is empty at the beginning of a server visit, ii = 0, the 
server will leave immediately, i.e., P(Nf = Nj) = 1. For this reason, we will 
exclude the latter obvious case from the analysis in the following, however, we 
will include it when we will uncondition on N^. 

Let N(i) := {Ni{t), . . . , TVa/ (t), D{t)) denote the M-f 1-dimensional, continuous- 
time Markov chain with discrete state-space £,k = {1, • • • , L—1} x {0, 1, . . .}*^~^ x 
{0, 1, . . .}U{a}, where Nj{t) represents the number of jobs in Qj at time t during 
a server visit to Qi, and D(t) is the total number of departures from Qi until 
t. State {a} is absorbing. This absorbing Markov chain is denoted by AMC^. 
The absorption of AMCfc occurs when the server leaves Qi which happens with 
rate 1/bi from all transient states with D{t) — k — 1 or Ni{t) = 1. 

We set N(0) — (Nj, 0). The probability that the transition to the absorption 
state occurs from one of the states {{ji, ■ ■ ■ jJm)}, ji > 2, equals Pl(N^ = 
(ji — 1, . . . , jAf ) I NJ) and the absorption is eventually due to k departures from 
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Qi with rate 1/bi. If the absorption is due to Qi becoming empty, Pl(N5' = 
(0,j2...,jM) I N^) equals the probabiHty that the transition to absorption 
is with rate 1/bi and it occurs from state {(1, j2, • ■ • , Ja/)}- Note that it is 
possible that the k-th departure at Qi leaves behind an empty queue. In our 
analysis we will consider this event as a transition to absorption that is due to 
Qi becoming empty. The non-zero transition rates of AMCfe can be written 
for all n = (ni, . . . ,nM,j) ^ S,k - {a}, 



g(n,n + ei) 
g(n, n + e;) 
g(n, n-ei + cma 

q{n,{a}) 



Ai, ni = 1, . . . , L - 2, 

Xi, l = 2,...,M, 

m = 2,...,L-1, 
j = 0, . . . , /c - 2, 

l/6i, ni = 1 or j = A: — 1. 



We derive now Pl(N![ = (ji, . . .Jm) \ = {h, . . .,iM))- We order the 
transient states of AMC^ lexicographically according to um, nM-i, ■ ■ ■, ?^2, 
then to j, and finally according to ni. During a server visit to Qi, the number 
of jobs at Qj, j — 2,...,M, may only increase. Therefore, similarly to the 
automous-server and time-limited discipline, we deduce that the joint moment 
of the p.g.f. of and the event that the absorption is due k to departures, 
denoted by {k dep.}, given Nj, reads 



Er 



^"^l{k dep.} I = 



7»M 



' ei X 



(C2 + (Z2A2 + . . . + zmXm)i) ^Hzi), (31) 



where ei is a k-dimensional row vector of zero entries except the first that is 
one, (C2 -I- (Z2A2 -I- ... -I- 2Af Aa/)!) is a k-by-k upper-bidiagonal block matrix of 
upper diagonal blocks equal to U, where U is an (L-l)-by-(L-l) lower-diagonal 
matrix whose entries equal to I/61, and of diagonal blocks equal to D, where 
D is the sum of the generator matrix of a M/M/l/L-1 queue with arrival rate 
Ai and service rate restricted to strictly positive states, and of the matrix 
-(A2(l - Z2) + • • • + AAf(l - zm) + 1/61)1, and 



h{zi) := q{zi)®ek, 

q{zr) := (0,zi,...,zf-2)^, 



(32) 
(33) 



and where is a k-dimensional column vector of zero entries except the k-th 
that is one. Plugging the inverse of ^C2 + (2:2A2 + . . . + za/Am)!^ into ([?T|) gives 
that 



l{k dep.} I ^1 



, *Af , 



-l/6iz^^...z^'e,, X 



''Z(^i),(34) 
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The joint moment of the p.g.f. of Nf and the event that the absorption is due 
to empty Qi, denoted by {Qi emp}, given Nj, reads 



{Qi emp.} I - 



= -l/bizl^ . . . z^ye,, ® ei( C2 + (Z2A2 + . . . + zmXm)1 



ei 



,(l-(-D-iU)')(D + U)-^i. 



(35) 



Summing the latter two p.g.f. gives Ei[z^i | N^] . It remains to find first 
ei,{ - D-iU) , second (D-i)g(zi) and (D + U)" ei, so that finally we will 
take the limit for L -4 00 of El [z'^i [ Nj] . 



5.1 ei,{-'D-^vf 

The matrix D is an (L-l)-by-(L-l) upper-bidiagonal matrix with upper-diagonal 
entries equal to Ai and diagonal equal to — Ai(a;, . . . ,x,xo), where x := (Ai + 
A2(l -Z2) + ... + Am(1 - zm) + l/&i)/Ai and xq := (A2(l - Z2) + . . . + Am(1 - 
zm) + l/&i)/Ai. Thus, it is easy to show that — D^-'U = (a;6iAi)^^L, where 



L = 







X ^ X ^ 


X 




h3 




\ 




1 


X X 


X 


-L- 


h4 












1 x-^ 


X 


-L- 


h5 

















1 









V 
















/ 



For n > 1, note that the (i,j)-entry of L", can be written as c"(i, j)x~"+*~^ , 
j — 1, . . . , L — 3. We do not consider the (i,j)-entry of L" with j > L — 2 since 
these entries will tend to zero when we will take the limit for L — > cxd. The 
coefficients c"{i,j) are strictly positive integers for 1 < i < n and 1 < j < L — 2, 
and n+l<i<L — 1 and i — n < j < L — 2, and zero otherwise. Moreover, 
the sequence {c"(i,j)} satisfies the following recurrent equation for n > 2, 
1 < i < i - 1 and 1 < j < L - 2, 

i+i 

c^{i,j) = c"(i, J - 1) + c"-i(j, J + 1) - ^c"-i(i,Z), (36) 

1=1 

where 

( 1, i = l,l<.1 <L-2, 
c^(ij) = ) 1, 2<i<L-l,i-l<j<L-2, (37) 
[ 0, otherwise. 

The coefficient c"(i, j) can be interpreted as the number of paths in the directed 
graph in Figure [T] Especially, c^li^j) equals the number of paths from state i 
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in level l{0) to state j in level l{n). Thus by an induction argument, it can be 
shown that c"{i,j) has the following solution for 2 < n < L — 2. That is, for 
j — 1, . . . , L — 2 and n <C L, 



2n + j- i- l 
n-1 



for i = 2, . . . ,n ~ 1 and j = 1, . . . , L — 2, 

c"(^,J) = 
for i — n and j = 1, . . . , L — 2, 

c"(n,j) 

for — n — 1 and j = i, . . . , L — 2, 



2n + j - 2 



2n + J — z — 1 
n + j 



n + i - I 
n- 1 



n + j — i — 1 
n-1 



and c"(z,_;/) equals zero for i = n + 2,...,_L— 1 and j = 1, . . . , z — n. 

(1,11) (2,n) (3,n) (L-l,n) 

l(n-l)_ 



1(01 







1 


2 


3 


1(2) ^ 








L.I 




M 

(aj J ^ 


2 *" 


3 " 










3 






1 .1 





(38) 



(39) 



(40) 



(41) 
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Figure 1: Directed graph for the computation of c"(z, j). 

Finally, we conclude that 6,;^ ( — D^^U)'" is a row vector of size L — 1 that 
is equal to (a;6iAi)"'''L*'' with j-th element equal to 



(Ai6i)'=' 



-2k+ii-j 



(42) 



for j ~ 1, . . . , L — 3. Note that since |a;| < 1, the limit of (|42|) tends zero for 
L oo. 



5.2 (D-i)g(zi) and (D + U) ^ei 



The matrix D is a (L-l)-by-(L-l) upper-bidiagonal matrix with upper-diagonal 
(Ai, . . . , Ai) and diagonal — Ai(x, . . . , x, xo), where x and xq are defined in Sec- 
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tionO Thus, 



( X ^ X X 

X-^ 







V 



-L+2 



X 

X' 



Using ([55]) . we find that D ^^(zi) is an (L-l)-dimensional column vector of i-th 
element, denoted as d{i), equal to 



1 

1 

a7 



1 - (zi.T-1) 



X ~ Zi 



X — Zl 



+ X ^ ^ Xq Zl ^ , 



for J 



, L — 1. Note that |2:i/a;| < 1 which gives that 



lim 



lim c?(i) 



1 / ZiX 



Ai — Zl 



(43) 

(44) 
(45) 



Ai Vx — Zl / 
for all i < oo. 

Now we compute (D + U)~^ei. Recall that (D + U) is an (L-l)-by-(L-l) 
tridiagonal matrix with upper-diagonal entries equal Ai , diagonal — Ai (a;, . . . , x, xq) 
and lower-diagonal entries l/6i. Therefore, (D -I- U) is equal to the matrix 
Qt(z) in ([221) with ai — 0. We note that the inverse of Qt(z) was computed 
in ((24|) . thus using these results we find that (D + U) ^ei is a column vector 
equal to (p(l), . . . ,p{L — 1))^ with the i-th entry that is given by 



= -bi 



yny2i - 1 

vii - vii 



^ + Ai6?^ 



V2l 



2/21 -Vii 



where j/n and yi\ are the distinct roots of 



Ai2/^-sty + l/6i 



(46) 



(47) 



where s* := Ai + l/6i + X]m=2 ^m^X ^ ^m)- Note that in this case \yii\ < 1 < 
\y2i\, so that we may find that. 



lim p{i) 

L — >OQ 



(48) 
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for all i < oo. 



5.3 Limit of E^fz^i | N^] for L ^ oo 

Plugging e,,(D-iU)\ (D-i)g(zi) and (D + U)"^ei into [z'^i | N\] and 
taking the limit for L ^ oo gives that 

where, 



S 



for k>2. 

Due to the complexity of the analysis for an arbitrary fc, we will restrict 
ourselves to the 1-limitcd and 2-limited disciplines. 

1-limited. First take the limits of d{i) and p{i) in ([45]) and p8)) . then plugging 
fc = 1 into ([33]) and gives that 



for Ji = 1, and 



Elz-MNJ] . 4^^,=S'(^;J;;-^), (51) 

for ii = 2, 3, . . . . Unconditioning on (N^^, . . . , N^^^), we find that 

('- v...A.a-'::;+A.,i-,J '[-^'iL..,- <^^' 

2-limited. Plugging fc = 2 in gives that p.g.f. of Nf then gives 



for ii = 1, and 
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for i^2,3,... . Unconditioning on = (N^i, . . . , N^/i), we find that 



^1 ^1 wFi . „N 



zi=0 



\ibix Xibfx{x — zi) 



y[^^.^^,yz^']. (55) 



Remark 1 The results for 1-limited and 2-limited can also be obtained more 
directly by explicitly conditioning on the number of jobs at the beginning of a 
server visit to a queue and keeping track how the queue-length evolves. However, 
our analysis above shows that our tool can also applied to the k-limited discipline 
for fc > 3. 

Remark 2 Exhaustive discipline:. The k-limited discipline for k oo is 
equivalent to the exhaustive discipline. Since ( — D^^U) is a sub-stochastic 
matrix with the sum of its row entries strictly smaller than one, the limit ( — 

D~"'^U)'^ for k — > oo. Therefore, taking the limit in and Ii35\) for 

k oo and summing these limits give that 

Ei[zNi I N?] =-l/6iz^^..4fe,,(D + U)"'ei. (56) 

The limit o/El[z'^i | N\] for L oo then reads 

E[zNi I Nl] = (57) 

Finally, the unconditioning on gives that 

7f(z) = /3f(z^), (58) 

where = (yn, Z2, . . . , zm). Considering a server visit to Qi, an equivalent 
relation can be derived for (z) and (if (z* ) as follows 

7f(z) = /3f(z*). 

Now including C^~^ , the switch-over time from Qi-i and Qi, it is easy to find 
that 

7f(2) = 7f-i(zI)C^-'«)- (59) 
where z* := (zi, . . . , Zi_i, yii, z^+i, . . . ,zm) and yu is the root of 

+ (60) 

with \yii\ < 1 and where s* = A; + l/foj + Ylm=i,m^i ~ ^m)- Eq. is 

equivalent to the well-known relation of exhaustive discipline in (see, e.g., |^ 
Eq. (24)]). 
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6 Iterative scheme 



In this section, we will explain how to obtain the joint queue-length distribution 
using an iterative scheme. First, let see how to compute 7j(z) as function 
7j_i(z), where z = (zi, . . . , zm)- 

Note that 7i(z) is a function of 7i_i(z) and 7i_i(z*) where z* — (zi,... 
, z,;-!, a, Zi^i . . . , Zm) with = 1, ?' = 1, . . . , M and \a\ < 1, which is a function 
of zi for alH = 1, . . . , M and I ^ i. Since 7^-1 (z) is a joint p.g.f., the function 
7i_i(z) is analytic in Zi for all zi,. . . , Zi-i, Zi+i, . . . , zm- Hence, we can write 

00 

')'»(^) = X] 9in{zi, Zi-1, Zi+i ZM)Zi, \a\ < 1, 

n=0 

where gin{-) is again an analytic function. From complex function theory, it is 
well known that 

l-Ki Jc Zi — a 

where C is the unit circle and = —1, and furthermore 



, , 1 / 7^(Z) 

9in(Zi, Zj_i, Zj+i . . . , Zm) = f n+1 



27ri Jc 



C z. 



dzi. 



where n = 0, 1, . . . . These formulas show that we only need to know the joint 
p.g.f. 7i_i(z) for all z with \zi\ = 1, to be able to compute 7i(z). 

When there is an incurred switch-over time from queue i — 1 to i the p.g.f. of 
the joint queue- length at the end of the n-th server visit to Qi, denoted by 7"(z), 
can be computed as a function of 'y^_i{z). The main step is to iterate over all 
queues in order to express 7"^^(z) as a function of 7"(z). Assuming that the 
system is in steady-state these two latter quantities should be equal. Thus, 
starting with an empty system at the first service visit to Qi and repeating the 
latter main step one can compute 7f(z), 7^ (z), and so on. This iteration is 
stopped when 7"(z) converges. 



7 Tandem model 

We know that our tool can be applied also for Jackson-like queueing networks 

with a single server that can serve only one queue at a time. To show this, we 
will consider the example of a tandem model of M queues in series. Qi has Pois- 
son arrivals. The service requirement at Qi is distributed exponentially with 
mean 1/bi. In the model there is only one server serving the queues according 
to some schedule. The service discipline is either the autonomous-server or the 
time- limited. Observe that this tandem model is equivalent to polling system 
with the property that only Qi has a Poisson arrivals, the departures from Qi 
will join Qi+i ,i = l,...,M — 1, and that departures from Qm leaves the system. 
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Autonomous-server: according to this discipline the server continues the ser- 
vice of a queue until certain exponentially distributed time of rate ai will elapse. 
Consider a server visit to Qi following the same approach in Section [3] we find 
that the solution is similar to ([TT|) and the matrix involved has the same struc- 
ture as A2. For this reason, we find that 

where z* := (rn, Z2, . . . , zm) and rn is the root of Pi{r) ~ \ir^ — (Ai -I- + 
ai)r + Z2/&1 such that |rii| < 1. To relate E[z-'^^] to E[z'^>] for a server visit 
to Qi, i > 1, we find that 

^e-, a^[z,+i ~ z,) ( riiE[(z*)N'] ZjE[z 



= ^'^7, . - - (62) 

ri\Zi) \ Zi+i — rii Zi^x—Zij 

where z* := (zi, . . . , Zi_i, ri^, Zi^\ . . . , zm) and ru is the root of Piir) = — (Ai(l— 
Zi) + l/bi + ajr + z^+i/bi such that |rii| < 1. 



Time-limited: according to this discipline the server continues the service 
of a queue until certain exponentially distributed time of rate ai will elapse or 
the queue becomes empty, whichever occurs first. Consider a server visit to Qi 
following the same approach in Section [5] we find that 




where z* := (ru, Z2, . . . , zm) and ru is the root of Pi{r) = Air^ — (Ai + 1/bi + 
ai)r + Z2/61 such that |rii| < 1. To relate E[z-'^'] to E[z'^'] for a server visit 
to Qi, i > 1, we find that 

where z* := (zi, . . . , Zi_i, r^, z^+i . . . , zm) andri; is the root of Pj(r) = -(Ai(l- 
Zi) + 1/bi + o:i)r + Zi^i/bi such that |rii| < 1. 



8 Discussion and Conclusion 

In this paper, we developed a general framework to analyze polling systems with 
the autonomous-server, the time-limited, and the k-limited service discipline. 
The analysis of these disciplines is based on the key idea of relating directly 
the joint queue-length distribution at the beginning and the end of a server 
visit. In order to do so, we used the theory of absorbing Markov chain. The 
analysis presented in this paper is restricted to the case of service requirement 
with exponential distribution. We emphasize can be extended to more general 
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distribution such as the phase- type distributions. For instance, Eq.[TT] holds in 
the case of phase-type distribution, however, the matrix A2 becomes a block 
matrix which is difficult to invert in closed-form. 

In this paper we showed that our tool is not restricted only to the disciplines 
that do not verify the branching property. For example, we analyzed the exhaus- 
tive discipline. Moreover, we claim that with an extra effort one can analyze 
the gated discipline for which there already exist results in the literature. 
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